Description

About the Company:

Established in 2005, Benchmark IT Solutions India Pvt Ltd has been a trusted partner in delivering robust software solutions. Founded by professionals with strong software development backgrounds, the company has built a reputation for quality delivery and long-term client satisfaction. Over the years, the organization has scaled to over 200 team members, adopting a wide range of modern technology stacks to consistently meet client expectations.

About the Role:

We are hiring a Data Engineer for a 6-month Contract-to-Hire (C2H) opportunity, based in Baner, Pune. This role involves architecting and building scalable and reliable data pipelines within a modern cloud data stack. The position is ideal for candidates who are passionate about handling large-scale data operations, building efficient workflows, and collaborating with cross-functional teams including AI/ML and DevOps.

Key Responsibilities:

• Design and maintain scalable data pipelines using Apache NiFi, Apache Airflow, and PySpark
• Build real-time and incremental data processing solutions using Apache Hudi, Apache Flink, and Apache Spark
• Optimize federated queries through Trino (Presto) and PostgreSQL
• Ensure robust data governance, security, and access control using RBAC and cloud-native practices
• Monitor and automate data workflows using Prometheus and OpenTelemetry
• Work closely with data scientists, backend engineers, and AI/ML specialists for seamless data integration
• Develop and support cloud-based data lake solutions on AWS, Azure, or GCP

Key Technology Skills:

Apache NiFi, Apache Airflow, Apache Spark, PySpark, Apache Flink, Apache Hudi, Trino, Presto, PostgreSQL, Python, SQL, Prometheus, OpenTelemetry, Kafka, Pulsar, AWS S3, Azure Data Lake, Google Cloud Storage, Terraform, CloudFormation, Docker, Kubernetes, RBAC, Cloud Security, Data Governance

Requirements

• 3.5–6 years of experience in Data Engineering, Big Data, or Cloud Data Solutions
• Strong proficiency in Python and SQL for scripting and data transformation
• Hands-on experience with: Apache NiFi, Apache Spark (especially PySpark), Apache Flink, Apache Airflow for job orchestration, Apache Hudi for data versioning, Trino (Presto) and PostgreSQL
• Understanding of data security, governance, and RBAC implementations
• Familiarity with observability tools like Prometheus and OpenTelemetry

Preferred Qualifications:

• Knowledge of real-time streaming frameworks like Kafka or Pulsar
• Experience with cloud storage platforms like AWS S3, Azure Data Lake, or Google Cloud Storage
• Understanding of Infrastructure as Code (e.g., Terraform, CloudFormation)
• Exposure to containerization and orchestration using Docker and Kubernetes

Why Join Us?

• Work with state-of-the-art cloud-native data technologies
• Be part of a collaborative, cross-functional team including AI/ML and DevOps experts
• Opportunity to transition into a full-time role based on performance
• Gain valuable exposure to scalable architecture and modern data engineering practices